Framework for spontaneous 3D referring gestures analysis
نویسندگان
چکیده
This paper presents a framework proposal aiming at analysing 3D spontaneous referring gestures which occur in multimodal interactions. Our approach is co mposed by two main steps: a structural segmentation of 3D continuous gestural signal and a perception or iented interpretation stage. Both modules which already exist have now to be merged, and the whole process validated with actual t ajectories.
منابع مشابه
Extracting and analyzing head movements accompanying spontaneous dialogue
This paper reports on a method developed for extracting and analyzing head gestures taken from motion capture data of spontaneous dialogue in Swedish. Candidate head gestures with beat function were extracted automatically and then manually classified using a 3D player which displays timesynced audio and 3D point data of the motion capture markers together with animated characters. Prosodic fea...
متن کاملGesture-based Object Recognition using Histograms of Guiding Strokes
Humans perform iconic gestures to refer to entities through embodying their shapes. For instance, people often gesture the outline of an object (e.g. a circle for a ball) when referring to it during communication. In this paper, we present a gesture-based object recognition algorithm that enables natural human-computer interaction involving iconic gestures. Based on our analysis of multiple ges...
متن کامل3D Corpus of Spontaneous Complex Mental States
Hand-over-face gestures, a subset of emotional body language, are overlooked by automatic affect inference systems. We propose the use of hand-over-face gestures as a novel affect cue for automatic inference of cognitive mental states. Moreover, affect recognition systems rely on the existence of publicly available datasets, often the approach is only as good as the data. We present the collect...
متن کاملA micro-analytic investigation of how iconic gestures and speech represent core semantic features in talk
This study investigates the communicational role that iconic hand gestures (see McNeill 1985) play in everyday talk. When we talk about iconic gestures, we are referring to very special sorts of hand movements, which most people produce unconsciously, and which seem to convey meaning associated with the content of spontaneous speech. Iconic gestures must be distinguished from all other types of...
متن کاملExtracting and analysing co-speech head gestures from motion-capture data
This paper reports on a method developed for extracting and analyzing head gestures taken from motion capture data of spontaneous dialogue in Swedish. The head gestures were extracted automatically and then manually classified using a 3D player which displays time-synced audio and 3D point data of the motion capture markers together with animated characters. Prosodic features were extracted fro...
متن کامل